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REMARKS/ARGUMENTS 
Claims 1-19 are now active in this application. 

The indication that claims 8 and 9 would be allowable if rewritten in independent 
form including all the limitations of the base claim and any intervening claims is 
acknowledged and appreciated. 



REJECTION OF CLAIMS UNDER 35 U.S.C $ 102 

Claims 1-7 and 10-19 are rejected under 35 U.S.C. § 102(a) as being anticipated 
by MAYA 2. 

The present application claims priority of Japanese Patent Application No. 11- 
372356, filed December 25, 1999, and a certified copy of the priority document was 
submitted with the filing of this application on December 28, 2000. The Examiner has 
yet to acknowledge the claim of foreign priority or that the certified copy of the priority 
document has been received. As the claim of foreign priority of Japanese Patent 
Application No. 11-372356 has been made and a certified copy of the priority document 
has been filed, the Examiner is requested to acknowledge the same. 

To perfect the claim of foreign priority, Applicants hereby submit a translation of 
Japanese Patent AppHcation No. 11-372356. Consequently, withdrawal of the rejection 
of claims 1-7 and 10-19 under 35 U.S.C. § 102(a) as being anticipated by MAYA 2 is 
respectfully solicited, as MAYA 2 is not a valid reference with respect to the present 
application. 
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CONCLUSION 

Accordingly, it is urged that the appHcation is in condition for allowance, an 
indication of which is respectfully solicited. If there are any outstanding issues that 
might be resolved by an interview or an Examiner's amendment, Examiner is requested to 
call Applicants' attorney at the telephone number shown below. 

To the extent necessary, a petition for an extension of time under 37 C.F.R. 1.136 
is hereby made. Please charge any shortage in fees due in connection with the filing of 
this paper, including extension of time fees, to Deposit Account 500417 and please credit 
any excess fees to such deposit account. 



600 13th Street, NW 
Washington, DC 20005-3096 
(202) 756-8000 EJW/dmd 
DATE: January 5, 2004 
Facsimile: (202) 756-8087 



Respectfully submitted. 



McDERMOTT WILL & EMERY 




Edward J. Wise /j 
Registration No. 74,523 
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NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the 
original precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 
[Claim(s)] 

[Claim 1] The description field of the 1st classification with which the 1st setups are 
filled is extracted from the two-dimensional image which photoed the body. As opposed 
to the geometric model of said body which extracted the description field of the 2nd 
classification with which the 2nd setups are filled from the depth map obtained by the 
three-dimension measurement to said body, and was obtained by said three-dimension 
measurement The three-dimension configuration data processor for the model creation 
characterized by adding the data correction which deforms the part corresponding to the 
description field of the 1st extracted classification and the 2nd classification. 
[Claim 2] On the occasion of the extract of the description field of said 1st classification, 
it is a three-dimension configuration data processor for the model creation according to 
claim 1 which performs field division with reference to the image information of the 
perimeter about the part of the shade in said body. 

[Claim 3] The modeling system for the model creation characterized by having the three- 
dimension configuration data processor according to claim 1 or 2 which adds data 
correction to the geometric model of said body obtained by said three-dimension 
metering device based on the two-dimensional image of said body obtained by the 
photoelectrical inverter which photos a body, the three-dimension metering device which 
measures the configuration of said body, and said photoelectrical inverter. 



[Translation done.] 
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DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to three-dimension configuration data 

processing for creating the model of the body which exists. 

[0002] 

[Description of the Prior Art] The non-contact type three-dimension metering device 
(three-dimension camera) of a portable mold is commercialized, and it is used for the 
visual recognition of the data input to CG system or a CAD system, a somatometry, and a 
robot etc. As the non-contact measurement approach, although slit Ught projection 
(optical cutting method) is common, otherwise, pattem light projection, the stereo ** 
method, the interference fringe method, etc. are leamed. 

[0003] Moreover, available three-dimension CG software and the small three-dimension 
cut machine for hobbies are marketed with the personal computer. If these are used, a 
model and a creation object can be manufactured easily also at ordinary homes. 
[0004] On the other hand, a kind of automatic vending machine which creates a user's 
photograph-of-his-face seal on that spot is collecting popularity. A user throws in the coin 
for a tariff, and he makes a favorite pose in front of a camera, looking at monitor display. 
And if predetermined actuation is performed, the sheet with which a fixed number of 
seals were located in a hne will be created, and it will be discharged by output port. From 
most models, two or more altemative is prepared about a configuration, a counterpart 
lump pattem, etc. of a photograph of his face. 
[0005] 

[Problem(s) to be Solved by the Invention] According to the above-mentioned three- 
dimension metering device, the configuration of the various bodies which contain the 
body by handiness comparable as taking a photograph can be data-ized. Since it is a non- 
contact type, even if it is the case where the body is measured, a measurement candidate 
does not sense troublesomeness. Then, it is possible to use this three-dimension metering 
device for creation of a ****** model, if it is a photograph of his face. That is, if it 
combines with a three-dimension finishing machine, it is possible to measure a person's 
face and to create the model of a suitable scale factor on that spot. 
[0006] However, in non-contact three-dimension measurement, the element of the face 
which is not geometrically distinguished from others will not appear in a model. For 
example, although the so-called iris-of-the-eye part of the eyeballs is an important 
element by which a face is characterized, it is not distinguished from a pewter part. The 
eyebrows drawn with the makeup tools will also be assimilated to a frame. 



[0007] On the other hand, this principal may have sense of incongruity in the model 
which reproduced boom hoisting of a face faithfully. This is because color influences the 
perception of boom hoisting as a actual twist can also rise and have the seen lip of a 
warm color system. Even if a configuration is faithful, a non-colored model will look flat 
compared with the familiar face. Moreover, the model which exaggerated the element of 
a face intentionally is liked, or it is pleased with the model which made the nose 
somewhat actually high. 

[0008] That is, in creating the model of people's face, correction is needed among the 
geometric models obtained by three-dimension measurement about the part of the 
element of faces, such as an eye, the iris of the eye, a hp, and a nose. This invention aims 
at enabling creation of the model which the description on objective vision was reflected 
in the configuration, and was exaggerated if needed. 
[0009] 

[Means for Solving the Problem] In this invention, a part is specified using both depth 
maps obtained by the two-dimensional photography information on objective, and three- 
dimension measurement, and the geometric model emphasized locally is generated. 
[0010] The equipment concerning invention of claim 1 extracts the description field of 
the 1st classification with which the 1st setups are filled fi"om the two-dimensional image 
which photoed the body. As opposed to the geometric model of said body which 
extracted the description field of the 2nd classification with which the 2nd setups are 
filled fi*om the depth map obtained by the three-dimension measurement to said body, 
and was obtained by said three-dimension measurement The data correction which 
deforms the part corresponding to the description field of the 1st extracted classification 
and the 2nd classification is added. 

[001 1] The three-dimension configuration data processor concerning invention of claim 2 
performs field division with reference to the image information of the perimeter about the 
part of the shade in said body on the occasion of the extract of the description field of 
said 1st classification. 

[0012] The modeling system concerning invention of claim 3 is equipped with the three- 
dimension configuration data processor which adds data correction to the geometric 
model of said body obtained by said three-dimension metering device based on the depth 
map obtained by the photoelectrical inverter which photos a body, the three-dimension 
metering device which measures the configuration of said body, and the two-dimensional 
image and said three-dimension metering device of said body obtained by said 
photoelectrical inverter. 
[0013] 

[Embodiment of the Invention] Drawing 1 is the external view of the three-dimensional- 
model listing device 1 concerning this invention. The three-dimensional-model hsting 
device 1 measures a body configuration, has the function to process a raw material on 
that spot based on the measurement data, and is used as an automatic vending machine of 
the accessories article which modeled a user's face. The article created is the stereo with 
which the model of the face projected from the plate surface of a predetermined 
configuration (for example, square). It is also possible to add a specific boom-hoisting 
pattern to a plate surface (a part for a background). If the suitable metallic omaments for 
such an article are attached, it will become accessories, such as a pendant, a broach, and a 
key holder. Metallic omaments may be beforehand attached in a raw material. 



[0014] The floodlighting aperture 12 and the light-receiving aperture 14 for optical three- 
dimension measurement are prepared in the front face of the almost hfe-size Johan 
section of a case 10 with the display 16 for a user to check a pause. The light-receiving 
aperture 14 is used also for two-dimensional color photography. The bottom half section 
of a case 10 is jutted out over the front side rather than the Johan section, and the top face 
serves as a control panel 18. The output port 20 of goods is established in the front face 
of the bottom half section. 

[0015] A user stands toward the three-dimensional-model listing device 1, and throws in 
the coin for a tariff If a user performs start actuation after that, the three-dimensional- 
model listing device 1 will display the three-dimension geometric model (for example, 
surface model) which shows a measurement result while measuring the configuration of 
the body which exists within the limits of [ fixed ] a transverse plane. And if a user 
performs confirmation operation which directs the decision of composition, the three- 
dimensional-model listing device 1 will start three-dimension processing according to a 
measurement result. Goods are completed by the time amount for about several minutes. 
A user takes out goods from output port 20. 

[0016] Drawing 2 is the top view of a control panel 18. The input port 185 of a start 
button 181, a confirmation button 182, Cancel button 183, a joy stick 184, and a coin is 
established in the control panel 18. A start button 181 is a start actuation means, and a 
confirmation button 182 is a confirmation operation means. A joy stick 184 is used for 
modification directions of the composition of a model. In response to the Pan actuation 
leaned to right and left, the tilt actuation leaned up and down, and roll actuation of 
rotating a knob, revolution processing of a three-dimension geometric model is 
performed, and a processing result is displayed on serial. Moreover, Cancel button 183 is 
an actuation means for directing re-measurement, when the three-dimension geometric 
model as which the user was displayed is not pleasing. However, the count of effective is 
set to Cancel button 183, and re-measurement cannot be directed indefinitely. 
[0017] Drawing 3 is the functional block diagram of the three-dimensional-model listing 
device 1. The three-dimensional-model listing device 1 consists of modeling system lA 
which generates the three-dimension geometric model of model size, and processing 
system IB which actualizes a three-dimension geometric model 
[0018] ModeUng system 1 A contains the photography system 30 which changes into 
digital data appearance information of the user who is an original copy body (data-izing). 
The photography system 30 consists of the three-dimension metering device 34 which 
data-izes configuration information by slit light projection, two-dimensional photography 
equipment 36 which data-izes color information, and a controller 38. In addition, it may 
replace with slit light projection and other technique may be used for three-dimension 
measurement. The color picture data DC which are the photography information by the 
configuration data DS which are the measurement information by the three-dimension 
metering device 34, and two-dimensional photography equipment 36 are inputted into a 
data processor 40. Since the relative relation of the camera coordinate of three-dimension 
measurement and two-dimensional photography is known, it is easy to carry out 
aUgnment of the three-dimension geometric model based on the configuration data DS 
and the two-dimensional photography image. For example, since two-dimensional 
photography and three-dimension measurement can carry out with the same view if 
constituted like the three-dimension input unit shown in JP,9-145319,A, this alignment 



can be performed more easily. The data processor 40 is equipped with the image- 
processing circuit which is not illustrated, and performs various kinds of data processing 
including data correction peculiar to this invention. The controller 42 of a data processor 
40 also bears overall control of the three-dimensional-model listing device 1, and gives 
the suitable directions for the controller 38 of the photography system 30, and the 
controller 76 of processing system IB. A display 16 and the actuation input system 80 are 
connected to this controller 42. The actuation input system 80 consists of an above- 
mentioned control panel 1 8 and an above-mentioned tariff receipt device. 
[0019] On the other hand, processing system IB is equipped with the processing 
equipment 72 which cuts ingredients, such as a resin block, the ingredient feeder 74 
which performs supply in the processing location of an ingredient, and conveyance to the 
output port 20 of a workpiece, the controller 76, and the output port sensor 78. The 
detecting signal of the output port sensor 78 is inputted into a controller 42. 
[0020] In addition, a controller 42 may be made to take charge of control of the 
photography system 30 and processing system IB, and the circuitry which omitted the 
controller 38 and the controller 76 may be adopted. 

[0021] Drawing 4 is the perspective view showing an example of the device 
configuration of processing system IB. The ingredient feeder 74 has the stock section 
210 which contains the ingredient of a total of eight sorts of configurations. Storage space 
is estabUshed in the both sides of the straight-hne-like migration way 212, and the 
elevator 220 is arranged four pieces at a time along the migration way 212 in the storage 
space of each **. Two or more ingredients of the same class are accumulated on each 
elevator 220, and vertical migration control of an elevator 220 is performed so that the 
best ingredient may be located in predetermined height. If one kind of ingredient suitable 
for the model which it is going to create is specified, the specified ingredient will extrude 
as a work piece 216, and will be sent out from storage space with a rod 218 on the 
migration way 212. And the work piece 216 on the migration way 212 is sent into the 
table 200 of processing equipment 72 with the migration rod 214 with a chuck. 
[0022] In a table 200, a work piece 216 is fixed with two stoppers 202 and clamp fixtures 
204. And it is cut with the cutter 208 attached in the upper and lower sides, right and left, 
and order at the movable revolving shaft 206. 

[0023] After three-dimension processing is completed, a work piece 216 is pinched by 
the chuck at the head of the migration rod 214, is carried to the edge by the side of 
blowdown of the migration way 212, and is sent into an exhaust port 222. It may not be 
based on the migration rod 214, but a work piece 216 may be moved to an exhaust port 
222 from a table 200 by the sUpping trapezoid formula. 

[0024] The device configuration of processing system IB is not restricted to instantiation. 
For example, if an elevator is horizontally arranged [ ingredient / of the same class ] at 
the end of the array direction on each multistage shelf and an ingredient is extruded in an 
elevator from a shelf, the number of elevators can be reduced. You may also carry a work 
piece to a stowed position -> processing location -> blowdown location with an arm 
robot. It is also possible to replace with a cut and to create a model by technique, such as 
the laminating molding method (for the Mitsuzo form method to be included), laser 
processing (thermoforming), and molding processings (application of pressure etc.). 
Moreover, about an ingredient configuration, a user may enable it to choose a favorite 
appearance and floor to floor time may be made to make automatic selection of what 



becomes the shortest from two or more sorts of ingredients which made the model of a 
standard face beforehand. 

[0025] In the three-dimensional-model Usting device 1 of the above configuration, in 
order to create the face model by which it has boom hoisting showing the iris of the eye 
and eyebrows, and the nose and the Up were en5)hasized, the data correction which 
transforms automatically the three-dimension geometric model obtained by three- 
dimension measurement using the color photography information on the face is made by 
the data processor 40. 

[0026] Drawing 5 is the mimetic diagram of an extract of a face element. A data 
processor 40 extracts the field of a specific face element from distance data G3 which the 
two-dimensional image G2 which the color picture data DC express, and the 
configuration data DS express. With this operation gestalt, eyebrows, an eye, the iris of 
the eye (the iris and pupil), and a hp are extracted from the two-dimensional image G2. It 
is because these face elements have minute boom hoisting and the extract from distance 
data G3 is difficult. On the other hand, a nose and a neck are extracted from distance data 
G3. The perimeters (cheek etc.) and color are alike and a nose is because the extract from 
the two-dimensional image G2 is difficult. The same is said of a neck. 
[0027] The extract from the two-dimensional image G2 is performed in the following 
ways. ** Divide the two-dimensional image G2 into the field of a same color phase by 
clustering in a specific color space (for example, L* a* b* color space). ** the result ~ 
receiving - labehng - carrying out ~ a same color phase ~ and extract the continuous 
field. ** Match using the template beforehand created based on the statistics about the 
location and color of a face element, and select the description fields al, a2, a3, and a4 
equivalent to eyebrows, an eye, the iris of the eye, and a hp. In addition, when the 
metastoma bottom becomes shade and is dark from original, for example, the boundary 
of the hp of a red system and shade and the boundary of shade and a beige jaw are 
extracted, it asks for the imaginary line passing through the pars intermedia of these 
boundaries, and this imaginary line is made into a part of profile of a metastoma. That is, 
about the part of shade, field division is performed with reference to the colour 
information of the perimeter. 

[0028] The extract from distance data G3 is performed in the following ways. ** Divide 
distance data G3 into the field of the same range by clustering in the distance distribution 
from a three-dimension measurement origin/datum. ** the result — receiving — labeling - 
- carrying out — the same range ~ and select the continuous description fields (it is 
equivalent to a nose and a neck) bl and b2. 

[0029] Drawing 6 is the mimetic diagram of partial data correction. First, the part 
corresponding to the description fields bl and b2 of the 2nd classification extracted from 
the description fields al-a4 and depth map G3 of the 1st classification which were 
extracted from the two-dimensional image G2 in the above-mentioned way among the 
three-dimension geometric models specified with the configuration data DS is set as the 
object for correction. Next, the degree beforehand set up about each part Up for 
correction is transformed. 

[0030] Deformation is performed in the following ways. ** Set to san:5)hng point p the 
location where the mesh M vertical to a camera look was projected to the part Up for 
correction, and the lattice point of the mesh M in the part Up for correction was 
projected. ** Calculate the correction vector v of vertical setting-out die length to a 



model side toward a camera side with sampling point p as the starting point. The die 
length of the correction vector v is set up for every face element. For example, eyebrows 
are longer than an eye. ** Ask for the intersection (this is called profile point) q of Mesh 
M and the profile of the part Up for correction. ** Search for the curved surface which 
passes along the location (head point) p2 at the head of the correction vector v, and the 
profile point q. ** Compound the curved surface searched for and the original three- 
dimension geometric model. That is, it transposes to the curved surface Up2 which asked 
for the part Up for correction of the three-dimension geometric models. By this, the part 
Up for correction will rise, for example, the location of an eye or the iris of the eye will 
be expressed by the configuration. The same is said of the eyebrows drawn with the 
eyebrow pencil As for a nose or a lip, boom hoisting is emphasized. Moreover, a neck is 
assimilated to a background. Since the location of the profile point q does not change, the 
continuity of a field is maintained between eyebrows and the irises of the eyes, and those 
perimeters. 

[0031] Hereafter, actuation of the three-dimensional-model listing device 1 is explained 
using a flow chart. Drawing 7 is the Maine flow chart which shows actuation of an 
outUne. After a power source is switched on, in the waiting period which waits for 
actuation by the user, two-dimensional photography and the display of a photography 
result are repeated (#10, #12, #14). Moreover, an advice message is displayed 
periodically. If a tariff is injected and a start button 181 is pxished, while performing two- 
dimensional photography anew, three-dimension measurement will be performed (#16, 
#18). Predetermined data processing is performed (#20) and the obtained three-dimension 
geometric model is displayed (#22). At this time, appearance is raised with the 
application of the well-known graphic technique of attaching a shadow. And it waits for 
directions actuation. However, the latency time is limited, and if it passes over the time 
limit, it will be considered that it is that to which confirmation operation was performed. 
[0032] If a joy stick 1 84 is operated, a three-dimension geometric model will be rotated 
according to actuation as mentioned above, and it will display (#24, #38). If Cancel 
button 183 is pushed, it will return to actuation of a waiting period (#40, #10). However, 
re-measurement will be performed, if a user does not need to inject a tariff anew and 
pushes a start button 181 in this case. 

[0033] A push on a confirmation button 182 generates the data for processing control 
with reference to a processing condition database based on a three-dimension geometric 
model (#28). (#26) An ingredient is processed (#30). After processing finishes, goods are 
discharged (#32), and it checks that goods have been taken out by the output port sensor 
78, and returns to standby actuation (#34, #10). 

[0034] Drawing 8 is a flow chart which shows the content of data processing of drawing 
7 . Here, the next processing including the data correction selectively upheaved as 
mentioned above and compaction of floor to floor time, or compression of the depth 
direction for intentional flattening on a design is performed. 

[0035] While performing data smoothing and removing the abnormality data based on a 
noise, it avoids that excess reappears to fine irregularity (#200). Re-sampling processing 
is performed (#210). This is processing changed into the data which aligned by the lattice 
point of spacing, such as having carried out parallel projection fi*om a certain direction, in 
order to make the right pair of the input data carry out in the processing direction, when 
the face has turned to slant. For example, when the bottom of the lug of people's face 



becomes shade and cannot measure, after wearing a face upward and carrying out three- 
dimension measurement, data are convertible so that the face which turned to the usual 
transverse plane may be expressed. When there is no measure point in the location where 
the lattice point was projected, the measurement value of the perimeter performs a 
linearity complement. At this time, it becomes the vertical upper part at the time of the 
projected direction processing it, and each lattice point has data of height. Moreover, 
even when input data is based on central projection, input data can be changed into 
parallel projection data by this processing. 

[0036] A deficit part without data is complemented (#220). As the conq^lement 
technique, various technique, such as a Unearity complement and weighting is 
applicable. For example, all the parts into which data are missing are replaced with a 
fixed value (simple conqDlement). As the fixed value, the average of the set point, the 
minimum height, and the periphery location of a face can be considered. When the deficit 
section is thoroughly surrounded in the effective-data part, a linearity complement is 
carried out fi'om surrounding data. Moreover, you may replace with the existing three- 
dimension configuration data about the part which can expect that exact data are not 
obtained from the target property by optical three-dimension measurement hke the black 
eyebrows in people's face, or hair. In this case, the standard model of the face (first half 
side of a head) is prepared, and the data of the standard model which adjusted a location 
and size are used about a data deficit part. The following procedure performs adjustment 
of a standard model. Both eyes and opening are extracted from a two-dimensional image 
in the same way as the case of the data correction mentioned above, and the location of 
three reference points is calculated. And Une type conversion of a standard model is 
carried out so that each origin/datum of a standard model may be in agreement with the 
geometric model of location sixrvey. In addition, such composition is applicable to the 
part of not only the deficit part of a face but arbitration. 
[0037] After obtaining a three-dimension geometric model faithfiil to an object 
configuration by each above processing, data correction peculiar to this invention which 
actualizes eyebrows and the iris of the eye, and emphasizes a hp and a nose as mentioned 
above is made (#230). In addition, when performing whether data correction is made, it is 
also possible to prepare a mode change fiinction so that a user or a device-management 
person can choose which part (element of a face) is corrected 
[0038] Height compression processing is performed and the dimension of a three- 
dimension geometric model is contracted in the depth direction (#240). That is, the 
difference of elevation of the depth direction is made small, and floor to floor time is 
shortened. Moreover, for the application of a pendant or a medal, a superficial model is 
suitable. To compression, both of the technique, uniform conpression and un-uniform 
compression, can be apphed, and it can also use properly for every part to it. 
[0039] A part for the background of the three-dimension geometric models is detected 
(#250), This is pretreatment for correcting a part for a background. A user's tooth back is 
considered as the blue back, and if the result of color distinction of a two-dimensional 
image is used, detection for a backgroxmd will become easily and certain. 
[0040] Background conversion transposed to other data about a part for a background is 
performed (#260), For example, since depth is extremely deep, a part for a background is 
changed into data with shallow depth in order to shorten floor to floor time. The soUd 
side data which express patterns and geometric patterns, such as flowering trees and 



shrubs, also by flat-surface data are sufficient as the data to replace. 
[0041] Size adjustment in which a full-scale three-dimension geometric model is fitted to 
goods size is performed (#270). Moreover, resolution conversion in which the amount of 
data is fitted to the precision of processing equipment 72 is performed (#280). Although 
this processing projects the mesh of predetermined grid width of face and it re-samples in 
the lattice point, the direction to project is being fixed in the direction of a vertical at the 
time of processing. As the point of resolution conversion (the number conversion of 
data), first, the pitch between points and ** KUTORU variation define the configuration 
point group of the geometric model for processing, and the pitch range between points 
corresponding to ** KUTORU variation is read fi"om the property data table memorized 
beforehand, and is set up. That is, data are thinned out, a pitch is enlarged, or data are 
interpolated and a pitch is made small. What is necessary is only just to cull out, when the 
resolution of measurement is large enough. If the resolution conversion function is 
prepared, since the resolution of the three-dimension metering device 34 will not be 
limited, the activity gestalt of exchanging a measurement means according to an 
appUcation will be permitted. 

[0042] Alignment to which the parallel displacement of the zero of a coordinate is carried 
out so that the criteria location of a three-dimension geometric model may suit the last in 
the criteria location of processing is performed (#290). In addition, when using the 
ingredient with which predetermined irregularity was made above beforehand on the 
occasion of processing, in the processing data generation processing (#28 of drawing 7 ) 
in response to confirmation operation, the amount of cuts is computed by comparing the 
three-dimension geometric model obtained by the above processing with the irregularity 
made. 

[0043] Drawing 9 is a flow chart which shows the content of partial data correction 
processing of drawing 8 . As di'awing 5 explained, distinction in configurations, such as 
eyebrows and an eye, extracts the face element of the 1st difficult classification from the 
two-dimensional image G2 (#23 10), and distinction with colors, such as a nose and a 
neck, extracts the face element of the 2nd difficult classification from depth map G3 
(#2320). About the 1st classification and the 2nd classification, whichever may be 
extracted first, and extract processing of halving can also be performed in parallel. 
[0044] The part Up for correction is set up to a three-dimension geometric model 
(#2330), Mesh M is projected, and the correction vector v is calculated (#2340, #2350). 
Moreover, it asks for the profile of the part Up for correction, and the intersection (profile 
point) q with Mesh M (#2360). About the part Up for correction, and the profile point q, 
you may ask for whichever first, and the operation which asks for them can also be 
performed in parallel. 

[0045] And a field including the head point p2 of the correction vector v and the profile 
point q is searched for as a correction partial model (#2370), and the field searched for 
and the original three-dimension geometric model are compounded (#2380). 
[0046] Although the three-dimensional-model listing device 1 supposing the activity as 
an automatic vending machine was illustrated with the above-mentioned operation 
gestalt, it does not ask whether data processing concerning this invention is whether 
model creation is onerous and onerous. Not only cutback size but actual size or 
amplification size is sufficient as the size of a model. Living things other than a person 
are sufficient as an original copy body. 



[0047] 

[Effect of the Invention] According to invention of claim 1 thru/or claim 3, creation of 
the model which the description on objective vision was reflected in the configuration, 
and was exaggerated if needed can be enabled. 
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TECHNICAL FIELD 



[Field of the Invention] This invention relates to three-dimension configuration data 
processing for creating the model of the body which exists. 
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PRIOR ART 



[Description of the Prior Art] The non-contact type three-dimension metering device 
(three-dimension camera) of a portable mold is commercialized, and it is used for the 
visual recognition of the data input to CG system or a CAD system, a somatometry, and a 
robot etc. As the non-contact measurement approach, although slit light projection 
(optical cutting method) is common, otherwise, pattern light projection, the stereo ** 
method, the interference fringe method, etc. are teamed. 

[0003] Moreover, available three-dimension CG software and the small three-dimension 
cut machine for hobbies are marketed with the personal computer. If these are used, a 
model and a creation object can be manufactured easily also at ordinary homes. 
[0004] On the other hand, a kind of automatic vending machine which creates a user's 
photograph-of-his-face seal on that spot is collecting popularity. A user throws in the coin 
for a tariff, and he makes a favorite pose in front of a camera, looking at monitor display. 
And if predetermined actuation is performed, the sheet with which a fixed number of 
seals were located in a Une will be created, and it will be discharged by output port. From 
most models, two or more altemative is prepared about a configuration, a counterpart 
lump pattern, etc. of a photograph of his face. 
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EFFECT OF THE INVENTION 



[Effect of the Invention] According to invention of claim 1 thru/or claim 3, creation of 
the model which the description on objective vision was reflected in the configuration, 
and was exaggerated if needed can be enabled. 
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TECHNICAL PROBLEM 



[Problem(s) to be Solved by the Invention] According to the above-mentioned three- 
dimension metering device, the configuration of the various bodies which contain the 
body by handiness comparable as taking a photograph can be data-ized. Since it is a non- 
contact type, even if it is the case where the body is measured, a measurement candidate 
does not sense troublesomeness. Then, it is possible to use this three-dimension metering 
device for creation of a ****** model, if it is a photograph of his face. That is, if it 
combines with a three-dimension finishing machine, it is possible to measure a person's 
face and to create the model of a suitable scale factor on that spot. 
[0006] However, in non-contact three-dimension measurement, the element of the face 
which is not geometrically distinguished from others will not appear in a model. For 
example, although the so-called iris-of-the-eye part of the eyeballs is an important 
element by which a face is characterized, it is not distinguished from a pewter part. The 
eyebrows drawn with the makeup tools will also be assimilated to a frame. 
[0007] On the other hand, this principal may have sense of incongruity in the model 
which reproduced boom hoisting of a face faithfully. This is because color influences the 
perception of boom hoisting as a actual twist can also rise and have the seen lip of a 
warm color system. Even if a configuration is faithful, a non-colored model will look flat 
compared with the familiar face. Moreover, the model which exaggerated the element of 
a face intentionally is liked, or it is pleased with the model which made the nose 
somewhat actually high. 

[0008] That is, in creating the model of people's face, correction is needed among the 
geometric models obtained by three-dimension measurement about the part of the 
element of faces, such as an eye, the iris of the eye, a Up, and a nose. This invention aims 
at enabling creation of the model which the description on objective vision was reflected 
in the configuration, and was exaggerated if needed. 
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MEANS 

[Means for Solving the Problem] In this invention, a part is specified using both depth 
maps obtained by the two-dimensional photography information on objective, and three- 
dimension measurement, and the geometric model errphasized locally is generated. 
[0010] The equipment concerning invention of claim 1 extracts the description field of 
the 1st classification with which the 1st setups are filled from the two-dimensional image 
which photoed the body. As opposed to the geometric model of said body which 
extracted the description field of the 2nd classification with which the 2nd setups are 
filled from the depth map obtained by the three-dimension measurement to said body, 
and was obtained by said three-dimension measurement The data correction which 
deforms the part corresponding to the description field of the 1st extracted classification 
and the 2nd classification is added. 

[001 1] The three-dimension configuration data processor concerning invention of claim 2 
performs field division with reference to the image information of the perimeter about the 
part of the shade in said body on the occasion of the extract of the description field of 
said 1st classification. 

[0012] The modeling system concerning invention of claim 3 is equipped with the three- 
dimension configuration data processor which adds data correction to the geometric 
model of said body obtained by said three-dimension metering device based on the depth 
map obtained by the photoelectrical inverter which photos a body, the three-dimension 
metering device which measures the configuration of said body, and the two-dimensional 
image and said three-dimension metering device of said body obtained by said 
photoelectrical inverter. 
[0013] 

[Embodiment of the Invention] Drawing 1 is the external view of the three-dimensional- 
model listing device 1 concerning this invention. The three-dimensional-model Usting 
device 1 measures a body configuration, has the function to process a raw material on 
that spot based on the measurement data, and is used as an automatic vending machine of 
the accessories article which modeled a user's face. The article created is the stereo with 
which the model of the face projected from the plate surface of a predetermined 
configuration (for example, square). It is also possible to add a specific boom-hoisting 
pattem to a plate surface (a part for a background). If the suitable metallic ornaments for 
such an article are attached, it will become accessories, such as a pendant, a broach, and a 
key holder. Metallic ornaments may be beforehand attached in a raw material. 
[0014] The floodUghting apertxire 12 and the Ught-receiving aperture 14 for optical three- 
dimension measurement are prepared in the front face of the almost life-size Johan 



section of a case 10 with the display 16 for a user to check a pause. The hght-receiving 
aperture 14 is used also for two-dimensional color photography. The bottom half section 
of a case 10 is jutted out over the front side rather than the Johan section, and the top face 
serves as a control panel 18. The output port 20 of goods is established in the front face 
of the bottom half section. 

[0015] A user stands toward the three-dimensional-model Usting device 1, and throws in 
the coin for a tariff If a user performs start actuation after that, the three-dimensional- 
model listing device 1 will display the three-dimension geometric model (for example, 
surface model) which shows a measurement result while measuring the configuration of 
the body which exists within the limits of [ fixed ] a transverse plane. And if a user 
performs confirmation operation which directs the decision of composition, the three- 
dimensional-model listing device 1 will start three-dimension processing according to a 
measurement result. Goods are completed by the time amount for about several minutes. 
A user takes out goods from output port 20. 

[0016] Drawing 2 is the top view of a control panel 18. The input port 185 of a start 
button 181, a confirmation button 182, Cancel button 183, ajoy stick 184, and a coin is 
established in the control panel 18. A start button 181 is a start actuation means, and a 
confirmation button 182 is a confirmation operation means. Ajoy stick 184 is used for 
modification directions of the composition of a model. In response to the Pan actuation 
leaned to right and left, the tilt actuation leaned up and down, and roll actuation of 
rotating a knob, revolution processing of a three-dimension geometric model is 
performed, and a processing result is displayed on serial. Moreover, Cancel button 183 is 
an actuation means for directing re-measurement, when the three-dimension geometric 
model as which the user was displayed is not pleasing. However, the count of effective is 
set to Cancel button 183, and re-measurement cannot be directed indefinitely. 
[0017] Drawing 3 is the functional block diagram of the three-dimensional-model listing 
device 1. The three-dimensional-model listing device 1 consists of modeling system lA 
which generates the three-dimension geometric model of model size, and processing 
system IB which actuaUzes a three-dimension geometric model. 
[0018] Modeling system 1 A contains the photography system 30 which changes into 
digital data appearance information of the user who is an original copy body (data-izing). 
The photography system 30 consists of the three-dimension metering device 34 which 
data-izes configuration information by slit hght projection, two-dimensional photography 
equipment 36 which data-izes color information, and a controller 38. In addition, it may 
replace with sUt light projection and other technique may be used for three-dimension 
measurement. The color picture data DC which are the photography information by the 
configuration data DS which are the measurement information by the three-dimension 
metering device 34, and two-dimensional photography equipment 36 are inputted into a 
data processor 40. Since the relative relation of the camera coordinate of three-dimension 
measurement and two-dimensional photography is known, it is easy to carry out 
aUgnment of the three-dimension geometric model based on the configuration data DS 
and the two-dimensional photography image. For example, since two-dimensional 
photography and three-dimension measurement can carry out with the same view if 
constituted hke the three-dimension input unit shown in JP,9-145319,A, this alignment 
can be performed more easily. The data processor 40 is equipped with the image- 
processing circuit which is not illustrated, and performs various kinds of data processing 



including data correction peculiar to this invention. The controller 42 of a data processor 
40 also bears overall control of the three-dimensional-model listing device 1, and gives 
the suitable directions for the controller 38 of the photography system 30, and the 
controller 76 of processing system IB. A display 16 and the actuation input system 80 are 
connected to this controller 42. The actuation input system 80 consists of an above- 
mentioned control panel 18 and an above-mentioned tariff receipt device. 
[0019] On the other hand, processing system IB is equipped with the processing 
equipment 72 which cuts ingredients, such as a resin block, the ingredient feeder 74 
which performs supply in the processing location of an ingredient, and conveyance to the 
output port 20 of a workpiece, the controller 76, and the output port sensor 78. The 
detecting signal of the output port sensor 78 is inputted into a controller 42. 
[0020] In addition, a controller 42 may be made to take charge of control of the 
photography system 30 and processing system IB, and the circuitry which omitted the 
controller 38 and the controller 76 may be adopted. 

[0021] Drawing 4 is the perspective view showing an example of the device 
configuration of processing system IB. The ingredient feeder 74 has the stock section 
210 which contains the ingredient of a total of eight sorts of configurations. Storage space 
is estabhshed in the both sides of the straight-hne-like migration way 212, and the 
elevator 220 is arranged four pieces at a time along the migration way 212 in the storage 
space of each **. Two or more ingredients of the same class are accumulated on each 
elevator 220, and vertical migration control of an elevator 220 is performed so that the 
best ingredient may be located in predetermined height. If one kind of ingredient suitable 
for the model which it is going to create is specified, the specified ingredient will extrude 
as a work piece 216, and will be sent out fi-om storage space with a rod 218 on the 
migration way 212. And the work piece 216 on the migration way 212 is sent into the 
table 200 of processing equipment 72 with the migration rod 214 with a chuck. 
[0022] In a table 200, a work piece 216 is fixed with two stoppers 202 and clamp fixtures 
204. And it is cut with the cutter 208 attached in the upper and lower sides, right and left, 
and order at the movable revolving shaft 206. 

[0023] After three-dimension processing is completed, a work piece 216 is pinched by 
the chuck at the head of the migration rod 214, is carried to the edge by the side of 
blowdown of the migration way 212, and is sent into an exhaust port 222. It may not be 
based on the migration rod 214, but a work piece 216 may be moved to an exhaust port 
222 from a table 200 by the slipping trapezoid formula. 

[0024] The device configuration of processing system IB is not restricted to instantiation. 
For example, if an elevator is horizontally arranged [ ingredient / of the same class ] at 
the end of the array direction on each multistage shelf and an ingredient is extruded in an 
elevator from a shelf, the number of elevators can be reduced. You may also carry a work 
piece to a stowed position -> processing location -> blowdown location with an arm 
robot. It is also possible to replace with a cut and to create a model by technique, such as 
the laminating molding method (for the Mitsuzo form method to be included), laser 
processing (thermoforming), and molding processings (application of pressure etc.). 
Moreover, about an ingredient configuration, a user may enable it to choose a favorite 
appearance and floor to floor time may be made to make automatic selection of what 
becomes the shortest from two or more sorts of ingredients which made the model of a 
standard face beforehand. 



[0025] In the three-dimensional-model Usting device 1 of the above configuration, in 
order to create the face model by which it has boom hoisting showing the iris of the eye 
and eyebrows, and the nose and the lip were emphasized, the data correction which 
transforms automatically the three-dimension geometric model obtained by three- 
dimension measurement using the color photography information on the face is made by 
the data processor 40. 

[0026] Di awing 5 is the mimetic diagram of an extract of a face element. A data 
processor 40 extracts the field of a specific face element from distance data G3 which the 
two-dimensional image G2 which the color picture data DC express, and the 
configuration data DS express. With this operation gestalt, eyebrows, an eye, the iris of 
the eye (the iris and pupil), and a Up are extracted from the two-dimensional image G2. It 
is because these face elements have minute boom hoisting and the extract from distance 
data G3 is difficult. On the other hand, a nose and a neck are extracted from distance data 
G3. The perimeters (cheek etc.) and color are alike and a nose is because the extract from 
the two-dimensional image G2 is difficult. The same is said of a neck. 
[0027] The extract from the two-dimensional image G2 is performed in the following 
ways. ** Divide the two-dimensional image G2 into the field of a same color phase by 
clustering in a specific color space (for example, L* a* b* color space). ** the result ~ 
receiving - labeling - carrying out ~ a same color phase and extract the continuous 
field. ** Match using the tenq^late beforehand created based on the statistics about the 
location and color of a face element, and select the description fields al, a2, a3, and a4 
equivalent to eyebrows, an eye, the iris of the eye, and a lip. In addition, when the 
metastoma bottom becomes shade and is dark from original, for example, the boundary 
of the lip of a red system and shade and the boundary of shade and a beige jaw are 
extracted, it asks for the imaginary line passing through the pars intermedia of these 
boundaries, and this imaginary line is made into a part of profile of a metastoma. That is, 
about the part of shade, field division is performed with reference to the colour 
information of the perimeter. 

[0028] The extract from distance data G3 is performed in the following ways. ** Divide 
distance data G3 into the field of the same range by clustering in the distance distribution 
from a three-dimension measurement origin/datum. ** the result ~ receiving - labeling - 
- carrying out - the same range ~ and select the continuous description fields (it is 
equivalent to a nose and a neck) bl and b2. 

[0029] Drawing 6 is the mimetic diagram of partial data correction. First, the part 
corresponding to the description fields bl and b2 of the 2nd classification extracted from 
the description fields al-a4 and depth map G3 of the 1st classification which were 
extracted from the two-dimensional image G2 in the above-mentioned way among the 
three-dimension geometric models specified with the configuration data DS is set as the 
object for correction. Next, the degree beforehand set up about each part Up for 
correction is transformed. 

[0030] Deformation is performed in the following ways. ** Set to sampUng point p the 
location where the mesh M vertical to a camera look was projected to the part Up for 
correction, and the lattice point of the mesh M in the part Up for correction was 
projected. ** Calculate the correction vector v of vertical setting-out die length to a 
model side toward a camera side with sampling point p as the starting point. The die 
length of the correction vector v is set up for every face element. For example, eyebrows 



are longer than an eye, ** Ask for the intersection (this is called profile point) q of Mesh 
M and the profile of the part Up for correction. ** Search for the curved surface which 
passes along the location (head point) p2 at the head of the correction vector v, and the 
profile point q. ** Compound the curved surface searched for and the original three- 
dimension geometric model That is, it transposes to the curved surface Up2 which asked 
for the part Up for correction of the three-dimension geometric models. By this, the part 
Up for correction will rise, for example, the location of an eye or the iris of the eye will 
be expressed by the configuration. The same is said of the eyebrows drawn with the 
eyebrow pencil. As for a nose or a Up, boom hoisting is emphasized. Moreover, a neck is 
assimilated to a background. Since the location of the profile point q does not change, the 
continuity of a field is maintained between eyebrows and the irises of the eyes, and those 
perimeters. 

[0031] Hereafter, actuation of the three-dimensional-model listing device 1 is explained 
using a flow chart. I>rawing 7 is the Maine flow chart which shows actuation of an 
outhne. After a power source is switched on, in the waiting period which waits for 
actuation by the user, two-dimensional photography and the display of a photography 
resuh are repeated (#10, #12, #14). Moreover, an advice message is displayed 
periodically. If a tariff is injected and a start button 181 is pushed, while performing two- 
dimensional photography anew, three-dimension measurement will be performed (#16, 
#18). Predetermined data processing is performed (#20) and the obtained three-dimension 
geometric model is displayed (#22). At this time, appearance is raised with the 
apphcation of the well-known graphic technique of attaching a shadow. And it waits for 
directions actuation. However, the latency time is limited, and if it passes over the time 
limit, it will be considered that it is that to which confirmation operation was performed. 
[0032] If a joy stick 184 is operated, a three-dimension geometric model will be rotated 
according to actuation as mentioned above, and it will display (#24, #38). If Cancel 
button 183 is pushed, it will retum to actuation of a waiting period (#40, #10). However, 
re-measurement will be performed, if a user does not need to inject a tariff anew and 
pushes a start button 181 in this case. 

[0033] A push on a confirmation button 182 generates the data for processing control 
with reference to a processing condition database based on a three-dimension geometric 
model (#28). (#26) An ingredient is processed (#30). After processing finishes, goods are 
discharged (#32), and it checks that goods have been taken out by the output port sensor 
78, and retums to standby actuation (#34, #10). 

[0034] Drawing 8 is a flow chart which shows the content of data processing of drawing 
7 . Here, the next processing including the data correction selectively upheaved as 
mentioned above and compaction of floor to floor time, or compression of the depth 
direction for intentional flattening on a design is performed. 

[0035] While performing data smoothing and removing the abnormality data based on a 
noise, it avoids that excess reappears to fine irregularity (#200). Re-sampling processing 
is performed (#210). This is processing changed into the data which aligned by the lattice 
point of spacing, such as having carried out parallel projection fi-om a certain direction, in 
order to make the right pair of the input data carry out in the processing direction, when 
the face has tumed to slant. For example, when the bottom of the lug of people's face 
becomes shade and cannot measure, after wearing a face upward and carrying out three- 
dimension measurement, data are convertible so that the face which tumed to the usual 



transverse plane may be expressed. When there is no measure point in the location where 
the lattice point was projected, the measurement value of the perimeter performs a 
linearity complement. At this time, it becomes the vertical upper part at the time of the 
projected direction processing it, and each lattice point has data of height. Moreover, 
even when input data is based on central projection, input data can be changed into 
parallel projection data by this processing. 

[0036] A deficit part without data is complemented (#220). As the conplement 
technique, various technique, such as a Hnearity complement and weighting ****^ is 
applicable. For example, all the parts into which data are missing are replaced with a 
fixed value (simple conplement). As the fixed value, the average of the set point, the 
minimum height, and the periphery location of a face can be considered. When the deficit 
section is thoroughly surrounded in the effective-data part, a linearity complement is 
carried out from surrounding data. Moreover, you may replace with the existing three- 
dimension configuration data about the part which can expect that exact data are not 
obtained from the target property by optical three-dimension measurement like the black 
eyebrows in people*s face, or hair. In this case, the standard model of the face (first half 
side of a head) is prepared, and the data of the standard model which adjusted a location 
and size are used about a data deficit part. The following procedure performs adjustment 
of a standard model. Both eyes and opening are extracted from a two-dimensional image 
in the same way as the case of the data correction mentioned above, and the location of 
three reference points is calculated. And line type conversion of a standard model is 
carried out so that each origin/datum of a standard model may be in agreement with the 
geometric model of location survey. In addition, such con^osition is appUcable to the 
part of not only the deficit part of a face but arbitration. 
[0037] After obtaining a three-dimension geometric model faithfiil to an object 
configuration by each above processing, data correction peculiar to this invention which 
actuahzes eyebrows and the iris of the eye, and emphasizes a Up and a nose as mentioned 
above is made (#230). In addition, when performing whether data correction is made, it is 
also possible to prepare a mode change fixnction so that a user or a device-management 
person can choose which part (element of a face) is corrected. 
[0038] Height compression processing is performed and the dimension of a three- 
dimension geometric model is contracted in the depth direction (#240). That is, the 
difference of elevation of the depth direction is made small, and floor to floor time is 
shortened. Moreover, for the appUcation of a pendant or a medal, a superficial model is 
suitable. To compression, both of the technique, uniform compression and un-uniform 
compression, can be applied, and it can also use properly for every part to it. 
[0039] A part for the background of the three-dimension geometric models is detected 
(#250). This is pretreatment for correcting a part for a background. A user's tooth back is 
considered as the blue back, and if the result of color distinction of a two-dimensional 
image is used, detection for a background will become easily and certain. 
[0040] Background conversion transposed to other data about a part for a background is 
performed (#260). For example, since depth is extremely deep, a part for a background is 
changed into data with shallow depth in order to shorten floor to floor time. The solid 
side data which express patterns and geometric pattems, such as flowering trees and 
shrubs, also by flat-surface data are sufficient as the data to replace. 
[0041] Size adjustment in which a fiiU-scale three-dimension geometric model is fitted to 



goods size is performed (#270). Moreover, resolution conversion in which the amount of 
data is fitted to the precision of processing equipment 72 is performed (#280). Although 
this processing projects the mesh of predetermined grid width of face and it re-samples in 
the lattice point, the direction to project is being fixed in the direction of a vertical at the 
time of processing. As the point of resolution conversion (the number conversion of 
data), first, the pitch between points and ** KUTORU variation define the configuration 
point group of the geometric model for processing, and the pitch range between points 
corresponding to ** KUTORU variation is read fi'om the property data table memorized 
beforehand, and is set up. That is, data are thinned out, a pitch is enlarged, or data are 
interpolated and a pitch is made small. What is necessary is only jxist to cull out, when the 
resolution of measurement is large enough. If the resolution conversion function is 
prepared, since the resolution of the three-dimension metering device 34 will not be 
limited, the activity gestalt of exchanging a measurement means according to an 
apphcation will be permitted. 

[0042] Alignment to which the parallel displacement of the zero of a coordinate is carried 
out so that the criteria location of a three-dimension geometric model may suit the last in 
the criteria location of processing is performed (#290). In addition, when using the 
ingredient with which predetermined irregularity was made above beforehand on the 
occasion of processing, in the processing data generation processing (#28 of drawing 7 ) 
in response to confirmation operation, the amount of cuts is confuted by conparing the 
three-dimension geometric model obtained by the above processing with the irregularity 
made. 

[0043] Drawing 9 is a flow chart which shows the content of partial data correction 
processing of drawing 8 . As drawing 5 explained, distinction in configurations, such as 
eyebrows and an eye, extracts the face element of the 1st difficult classification fi*om the 
two-dimensional image G2 (#2310), and distinction with colors, such as a nose and a 
neck, extracts the face element of the 2nd difficult classification fi-om depth map G3 
(#2320). About the 1st classification and the 2nd classification, whichever may be 
extracted first, and extract processing of halving can also be performed in parallel. 
[0044] The part Up for correction is set up to a three-dimension geometric model 
(#2330), Mesh M is projected, and the correction vector v is calculated (#2340, #2350). 
Moreover, it asks for the profile of the part Up for correction, and the intersection (profile 
point) q with Mesh M (#2360). About the part Up for correction, and the profile point q, 
you may ask for whichever first, and the operation which asks for them can also be 
performed in parallel. 

[0045] And a field including the head point p2 of the correction vector v and the profile 
point q is searched for as a correction partial model (#2370), and the field searched for 
and the original three-dimension geometric model are compounded (#2380). 
[0046] Although the three-dimensional-model listing device 1 supposing the activity as 
an automatic vending machine was illustrated with the above-mentioned operation 
gestalt, it does not ask whether data processing concerning this invention is whether 
model creation is onerous and onerous. Not only cutback size but actual size or 
amplification size is sufficient as the size of a model. Living things other than a person 
are sufficient as an original copy body. 
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DESCRIPTION OF DRAWINGS 
[Brief Description of the Drawings] 

[Drawing 1] It is the extemal view of the three-dimensional-model listing device 

concerning this invention. 

[Drawing 2] It is the top view of a control panel 

[Drawing 3] It is the functional block diagram of a three-dimensional-model listing 
device. 

[Drawing 4] It is the perspective view showing an example of the device configuration of 
a processing system. 

[Drawing 5] It is the mimetic diagram of an extract of a face element. 

[Drawing 6] It is the mimetic diagram of partial data correction. 

[Drawing 7] It is the Maine flow chart which shows actuation of an outline, 

[Drawing 8] It is the flow chart which shows the content of data processing of drawing 7 . 

[Drawing 9] It is the flow chart which shows the content of partial data correction 

processing of drawing 8 . 

[Description of Notations] 

40 Data Processor (Three-Dimension Configuration Data Processor) 
1 A Modeling system 

36 Two-dimensional Photography Equipment (Photoelectrical Inverter) 
34 Three-Dimension Metering Device 
DS Configuration data (geometric model) 
G2 Two-dimensional image 
G3 Distance data 

Up Part for correction (part corresponding to the description field) 
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